THE MOMENT MAP: NONLINEAR DYNAMICS OF DENSITY EVOLUTION VIA 
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Abstract. 

We explore situations in which certain stochastic and high-dimensional deterministic systems behave elfectively 
as low-dimensional dynamical systems. We define and study moment maps, maps on spaces of low-order moments 
of evolving distributions, as a means of understanding equations-free multiscale algorithms for these systems. We 
demonstrate how nonhnearity arises in these maps and how this results in the stabilization of metastable states. 
Examples are shown for a hierarchy of models, ranging from simple stochastic differential equations to molecular 
dynamics simulations of a particle in contact with a heat bath. 
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1. Introduction. An equation-free framework has recently been developed as a means 
of computationally analyzing the dynamical behavior of a large class of complex, multi- 
scale dynamical systems. The systems may be either stochastic or deterministic with many 
of degrees of freedom and subject to random initial data. The key observation behind the 
equation-free framework is that in many cases the quantities of interest are averages or low- 
order moments of evolving distributions which are smooth in space and time and which evolve 
effectively as closed, low-dimensional systems. In effect the low-order moments evolve as 
though they are governed by reduced closed equations, even though the reduced equations 
are not analytically available. Algorithms for performing scientific computing tasks such as 
numerical integration, or bifurcation and stability analysis of these unavailable reduced equa- 
tions have been developed (e.g. coarse projective integration, coarse Newton-GMRES, see 
0] 121 |3l |4l and references therein). These algorithms are based on traditional, continuum 
numerical analysis, "wrapped" around direct fine-scale simulation. The purpose of this paper 
is to establish a mathematical framework for understanding the behavior of coarse dynamics 
and coarse bifurcation methods on problems which exhibit metastable behavior. 

The systems we consider are exemplified by the following model. A particle, called the 
distinguished particle, with position Q and momentum P sits in a potential well V{Q). It 
is coupled via linear springs to a large number N of particles comprising a heat bath; see 
Figure n~T1 The potential well considered here is a slightly asymmetric double well. The 
full system is an + 1 degree of freedom Hamiltonian system. A detailed description of 
the model, including the choice of spring constants, masses, and initial data for the bath 
particles is given below and in f9l 1251 l38l . The important point is that the dynamics of 
this simple model (and the others that we consider in this paper) is typical of many more 
complex molecular and stochastic systems in which the state is primarily confined to a few 
conformations (here defined by the minima of V) with rare switching events between them. 
This is illustrated in Figure [l~2l with a typical trajectory and time series for the distinguished 
particle. 

Consider now the dynamics of an ensemble of trajectories for the model system. Fig- 
ure [O] illustrates the evolution of an ensemble of trajectories all with the same initial con- 
ditions {Q, P) = (0, 3) for the distinguished particle, but with different initial data for the 
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Fig. 1.1. Model system. A distinguished particle (light gray) sits in an asymmetric double well potential. The 
particle is coupled via linear springs to N other (bath) particles (three are shown as illustration). The full system 
has A'^ + 1 degrees of freedom. 



bath particles. (The total initial energy of the bath is approximately the same for all realiza- 
tions. See Sj2l) Over a time of order 10 the initial density evolves to a nearly Gaussian density 
centered near the bottom of the right well, where it remains roughly constant for some time. 
While not immediately evident, during the initial 10 time units, the density is never very far 
from Gaussian. However, it is evident from the left-hand plot that a small percentage of the 
realizations are located in the left well at time 10. Over a much longer time scale, 0(10''), 
the density evolves to the bimodal equilibrium distribution and is hence far from Gaussian. 
Thus the system exhibits metastability with near equilibration within one well dominating 
over medium time scales, before the system ultimately converges to an equilibrium distribu- 
tion which sees both wells. The time it takes the system to reach equilibrium clearly depends 
on the potential barrier height; the time scale of the intermediate time evolution to the well 
bottom depends only on properties of the particular well. 

Our aim is to study the behavior of coarse dynamics and coarse bifurcation methods on 
problems which exhibit metastable behavior of this type. In §2 we introduce a hierarchy of 
model problems, all of which exhibit rare transitions between a small number of states, and 
which we then use throughout as illustrations. 

In §3 we define the discrete-time moment map $ for the first k moments of the ensemble 
of solutions to a time evolving system. Specifically, $ will be a low-dimensional map for 
only the low-order moments, defined in a general setting which applies to both systems of 
ordinary differential equations (ODEs), with randomness from initial data, and stochastic 
differential equations (SDEs) with randomness from initial data and Brownian driving noise. 
Fi gure WA\ illustrates the first-order moment map for the heat bath example. The short-term 
dynamics of the map resemble those of the ensemble, but significantly, the moment map has 
stable fixed points corresponding to means of metastable densities centered in each well. The 
second-order moment map additionally captures the widths of the metastable measures. The 
algorithms we study are based on these maps. 

The heart of the paper is §4. It is devoted to the study of the moment map, when applied 
to a variety of model systems. We use a combination of exact solutions for Gaussian prob- 
lems, approximate solutions for metastable systems and numerical experiments. Of central 
interest is the observation that the moment maps stabilize the metastable states in the model 
problems of interest. The moment map is a nonUnear map, defined from the linear flow of 
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Fig. 1 .2. Typical behavior for the dynamics of the distinguished particle in contact with a bath with N = 8000 
particles. Most of the time the distinguished particle is located in one of the two potential wells, but occasionally it 
makes a jump between wells. 

probability densities for ODEs and SDEs, with the nonlinearity entering through the process 
of repeatedly projecting onto the space of moments. This process of nonlinearization creates 
interesting fixed points which are associated with metastable behavior, and are amenable to 
low dimensional bifurcation analyses; related issues are addressed in 1241 . §5 contains our 
concluding remarks. 

2. Model Problems. We consider three example systems in this paper. Two are SDEs 
and one is the ODE heat bath model described in the introduction, and illustrated in Fig- 
ure ll.ll A major thrust of this paper is to establish, through computational experimentation, 
that the moment map stabilizes metastable behavior arising from the slow dynamics between 
potential wells with large energy barriers; this gives rise to nonlinear phenomena, such as 
bifurcations, in the moment map. Such phenomena can be illustrated in both SDE models, 
and in the ODE heat bath model. Furthermore, in various parameter limits, the SDEs can be 
derived as approximations for the heat bath, further justifying their study. 

2.1. Heat-bath model. This model problem is defined by the Hamiltonian 

H{Q, P, q,p) = —P' + V{Q) + Y.^+Y.i^1j~ (2.1) 

J = l ^ 3 = 1 

where Q, P are the position and momentum of a distinguished particle of unit mass in a po- 
tential field V{-). The qj's and pj's are the coordinates and momenta of TV particles that are 
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Fig. 1.3. Evolution of an ensemble o/ 10* realizations for the model system. On the left density plots of 
position and momentum of the distinguished particle are shown at four times as labeled. For clarity only the first 
10^ realizations are plotted. The initial conditions are (Q, P) = (0, 3). The right shows the trajectory and time 
series for the ensemble expectations. Red points indicate the four times shown on the left. There are N = 8000 
particles in the heat bath. 



referred to as "heat bath" particles. The j-th heat bath particle has mass rrij and interacts 
with the distinguished particle via a linear spring with stiffness constant kj. If the distin- 
guished particle were held fixed it would be the anchor point of N independent oscillators 
with frequencies ujj — {kj /nijY/'^ . The numerical experiments are all conducted with mass 
M = 1. 

Initial conditions for the distinguished particle are: (3(0) = Qo. ^(0) = ^o- The initial 
data for the heat bath particles, qj{0) — and Pj{0) — p^, are randomly drawn from a 
Gibbs distribution with inverse temperature (3. The Gibbs measure is conditioned by the 
(non-random) initial data Qq and Pq. For fixed Q, P the Hamiltonian \2.l\ is quadratic in 
g, p, and hence the corresponding measure is Gaussian. It is easily verified that 

g° = Qo + (l//3A:,)i/%- 
p° = K-//3)V2,,„ 

where $^ ,77^ ~ A/^(0, 1) are mutually independent sequences of i.i.d. random variables. 

This leaves the specification of the parameters kj and rrij . For our purposes the only 
important property of these parameters is that the frequencies ujj — {kj /nijY^'^ cover an 
increasingly large range in an increasingly dense manner as the number of particles N in- 
creases. Hence what we actually specify is the frequencies. These are chosen to be random 
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Fig. 1 .4. Dynamics of a moment map for the first-order moments of the position Q and momentum P of the 
distinguished particle. The map has three fixed points; two stable foci and one unstable saddle shown as blue cross. 
Two trajectories are shown; one evolving to each of the stable fixed points. The right trajectory has initial condition 
{Q, P) = (0, 3), corresponding to that in fieure \l.3\ There are N = 8000 particles in the heat bath. 



and uniformly distributed in [0, TV^/'^], 



It is important to note that in addition to the initial data, the model specification itself contains 
this random element. We shall be careful to distinguish between the two types of randomness. 
From the frequencies the spring constants and masses are given by: 



kj — 



2a' 



iVi/3 



k 



(2.2) 



with a > 0. See |25| for further details. 

The parameters a and /3 are fixed at a = 100, /3 = 2. The potential considered in this 
paper is 



V{Q) = 



4 2 

where /x and ly are parameters with f typically small. 



(2.3) 



2.2. Two Dimensional SDE Approximation. For large N and a the distinguished par- 
ticle Q in the heat bath model can be approximated by the SDE 



MQ + jQ + V'iQ) ^ V27A3 W. 



(2.4) 



A theorem justifying this approximation can be proved using the techniques of weak con- 
vergence, by taking the limit N ^ oo ( L25J ) and then a ^ oo (I127J). In the absence of 
noise (the zero temperature hmit /? — > oo) this damped Hamiltonian system exhibits decay 
towards stationary points with zero velocity and positions at the critical points of V. The pres- 
ence of noise (finite f3) then induces transitions between the minima of V, with time-scales 
determined by the well-depths relative to the size of noise. 

2.3. One Dimensional SDE Approximation. The stochastic dynamics between poten- 
tial wells are also present in simple one dimensional SDEs. A particular instance of such a 
one dimensional SDE follows from ( 12. 4t for M ^ 1. In the limit M 0, the solutions of 
i2.4l converge strongly 1261 or weakly 1101 to solutions of the SDE 



iQ + v'iQ) = V^w. 



(2.5) 



We will use this problem to illustrate the moment map, and its properties on systems exhibit- 
ing metastable dynamics within potential wells. 



6 



D. BARKLEY, I.G. KEVREKIDIS AND A.M. STUART 



2.4. Remark. In most respects the SDE systems derived above are simpler to treat, 
and computationally they are far less expensive to simulate than the full heat bath model. 
Therefore, when we later use these models as examples, we will study the models in the 
opposite order from what has just been presented. We start with the ID SDE and examine 
its behavior extensively and then consider more briefly 2D SDE and the heat bath system of 
ODEs. 

3. The Moment Map. The central objects of our study are maps on moments. The 
basic ingredients are an evolution equation (either an SDE or system of ODEs), a space of 
low-order moments, and a measure determined uniquely by low-order moments. We refer to 
the latter as lifting and choice of the lifting operator is an essential ingredient in the method. 
We start with the SDE case, then describe the situation for ODEs. For both the SDE and the 
ODEs the flow on probability densities is linear. The nonlinearity inherent in the moment 
map comes from the relationship between the probability density function and its moments. 
After describing the moment map for the SDE and the ODE, the section concludes with some 
general remarks. 

3.1. The SDE Case. Let x e C([0, oo), R'*) solve the following Ito SDE, driven by 
Brownian motion W G C([0, oo), M™) : 

dx ^ , , , , dW ,^ , , 

— . (3.1) 

This includes ( 12. 4> and (12. 5> as special cases. We will consider ensembles of solutions of 
this equation, with ensembles taken over multiple driving noises and random initial data. Let 
Xj(t) be the j*'' moment of x(t), with expectation taken with respect to both the driving 
Brownian motion W and random initial data, the latter being assumed independent of the 
Brownian motion. Denote the first fc moments of x by X(t) = {Xi{t), . . . , Xk{t)). 

Let /i be a measure on K*^ determined by exactly k moments, with density p{x; X). Here 
X denotes the dependence of the density on the k moments and we require that the k moments 
of p are exactly those given by X. 

We now define the map $ on fc moments by 

= X(t) (3.2) 

where the initial data X{0) — xq is distributed with density p{x; X) and r < [0, < oo). 
(Note that if r = then $ is the identity.) We refer to this as the moment map. It depends on 
three choices that need to be made when calculating the moment map: 

(i) the evolution time t; 

(ii) the number of moments we choose to use; 

(iii) the lifting step: the way choose to distribute the initial density based on the moments. 
We will return to this dependence in more detail below. The two examples of the mea- 
sures which will be used throughout this paper are the Dirac measure and the Gaussian mea- 
sure, uniquely determined by the first moment and the first two moments, respectively. 

In practice we typically find this map through Monte Carlo simulation, but it is insightful 
to describe the definition of the map through the Fokker-Planck equation for ( 13. 1> . This linear 
PDE for the probabiUty densities p{x, t) propagated by ( 13. 1> is 

1^ = -V • ifp) + iv • V • (Ep) :=£>, (3.3) 

p{x,Q)^p{x-X) (3.4) 
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Fig. 3.1. Sketch illustrating the definition of the moment map. From a point (Xi, X2) in moment space a 
density p is uniquely determined. This initial density is evolved by the system dynamics (e.g. the Fokker-Planck 
equation). From the resulting density p(t), t time units later, a new point in moment space is determined. This point 
is defined to be the image of {X\ , X2) under the moment map. 



where S — a{x)a{x)'^ . Here £* is the adjoint of the generator for the process C. We denote 
the solution by 

p(x,t) = e^**p(a;;X). (3.5) 

From p{x, r) we can construct by ( 13. 2> . In general the moment map is nonlinear 

because of the nonlinear dependence of p{x\ X) on X and the nonlinearity of the map from 

t) to X{t) given by ( 13. 5> . Thus we have constructed a nonlinear map on from the 
linear flow on M'*— valued densities. 

It is helpful to consider Figure |3J1 illustrating the definition of the moment map. One 
should view the map as a composition of three steps: (1) lifting from a space of moments 
(subset of W^) to a space of probability densities (captured by our choice of /5(- ; X)); (2) time 
evolution of the density by the underlying process (a linear flow, given by the map ■^); (3) 
projection back to moment space by integrating against the time-evolved measure. 

In the case of a single moment, in this paper, we take /x to be a Dirac measure at X and 
then X{t) = ¥,x{t) can be calculated from 

= / xe'^'''5{x - X)dx. 

In the case of two moments we have 

X{t) = {Ex{t),E[x{t) - Ex{t)][x{t) - Ex{T)f} 

and we take /i to be a Gaussian measure with mean and covariance determined by these 
moments. It is convenient to express the moment map in terms of the mean X £ M."^ and 
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CO variance matrix E e M''^''. We obtain the map 

<I>(X,S) = 

The functions <i>i are defined as follows. Let 

exp(-i||I]-^(a;-X)||2) 



p{x;X,T,) 



v/((27r)'^detE) 



Then $i : R"* x R"^""^ R'^ is given by 

and $2 : K'' X R'^'^'^ R'^'^'^ is given by 

$2(^,S)= / (a:-$i(X,S))(x-$i(X,E))^{e^*"p(x;X,S)}da;. 

There is a connection between particle filters and the moment map, although the former 
represent the desired density as a sum of several delta functions, or Gaussians, not just as one 

EHl. 



3.2. The ODE Case. The moment map can be defined for deterministic problems of the 
form 

-^^f{x,y), (3.6) 

'^^9{x,y)- (3.7) 

Here a; S K'^ and y €E M"* and the randomness is assumed to come entirely from the initial 
data. In systems characterized by a separation of time scales, it is sometimes the case that 
one can write an effective reduced models in terms of a subset of (typically slow) variables. 
Under such appropriate conditions, we might, for example, be interested in finding a map in 
terms of the first k moments of x alone. Thus the measure /i must be chosen on M'' x M™ so 
that it is uniquely characterized by X, the first k moments of x € M'*. It is natural to choose 
p. to be an invariant measure for the flow, conditioned by knowledge of the first k moments of 
x\ if the flow is Hamiltonian then a Gibbs measure is often used. We denote the density as- 
sociated with this measure by p{x, y; X). This occurs in the heat bath example considered in 
the introduction where x represents coordinate and momentum of the distinguished particle, 
whilst y represents the heat bath coordinates and momenta. 

Rather than the Fokker-Planck equation i3.3i we have the Liouville equation for propa- 
gation of probabihty densities. This is 

If = -V. • (/p) - V, • (gp) ■.^C*p, 

p{x,y,0) ^p{x,y;X) 

and we denote the solution by 



p{x,y,t) = e^'*p{x,y;X). 
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In the case of a Dirac mass we take p{x, y; X) — 6{x — X)p{y; X) and then the map 



Here p{y; X) is chosen so that S{x — X)p{y; X) is the density of p conditional on x — X. 
Generahzation to Gaussian, and higher moment problems, is also possible. 

3.3. General Remarks. 

• Notation. We use X to represent a point in the moment space up to some order k, 
which will be made explicit for each particular example we consider. In practice, the 
coordinates used to describe the moment space are dictated by the particular prob- 
lem. For example, in our case we use the mean and standard deviation as coordinates 
when considering k — 2 and d = 1. For k = 2 and d = 2 we use the two means, the 
two standard deviations, and the cross correlation as coordinates. 

• Usage. In discussing moment maps we often do not distinguish between a point X in 
moment space and the uniquely determined density p(- ; X) based on this point. That 
is, we sometime speak of the moment map as mapping X" to and sometime 
speak of the moment map as taking mapping density p{-; X") to density p{-; X""*"^). 

• Relation to Optimal Prediction. The map $ can be used to generate an approximate 
vector field by defining 



For the ODE case i3.6\ and p a Dirac at X, the limit t ^ coincides with the 
vector field found by the method of optimal prediction |6|; this is demonstrated in 
|12'| . In general the method of optimal prediction leads to errors which grow linearly 
in time T 1 1 3 1 . The approach we study here attempts to overcome this error growth 
by closing the system with a larger number of moments. 

• Previous Work For simple problems in chemical kinetics, which are modeled by 
birth-death processes, the equation for the first moment is a closed ODE, in the limit 
of a large number of independent particles, and the moment map studied here then 
works well in the Dirac mass case 1 14 15 16 1. For more complex problems, such as 
lattice Boltzmann, a closed effective PDF may sometimes be found, using first and 
second moments and, again, the moment map works well in this case p1l2l ll7lfT8l . 
In this paper we study examples where no closure is proven to exist, and demonstrate 
the properties of the moment map. In particular we study the relevance of fixed 
points of this map to the identification of metastable states. Although no rigorous 
analysis is presented, the numerical studies show that the moment map has some 
merit as a method for elucidating long-term dynamics of large systems, through low 
dimensional dynamical systems studies. 

• Lifting Initialization of the detailed simulation consistently with coarse-grained ob- 

servables is the lifting step in equation-free computation 1 1 2,-3 191 . This step is 

obviously not unique, as there exist many ways of initializing a distribution con- 
ditioned on a few of its lower order moments. Our choice of a particular measure 
depending only on the lower order moments allows for a systematical initialization 
of the fine scale dynamics, a concept that goes back to Ehrenfest 1201 1211 . and is an 
important component of our computational approach. In the case of systems with 
metastability, different effective dynamics will be deduced (different closures will 
be obtained) depending (a) on the time scale of the observation (the time horizon of 
the simulation r with the fine scale solver) and (b) on the nature of the lifting from 
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the moments (the choice of p). Over very short times, and initializing with a Dirac 
delta function, the simulation will effectively sample the local gradient of the well; 
over medium times, and initializing within one well, one will observe equilibration 
within this well; and over very long times (no matter what the initialization) one will 
observe the approach to the equilibrium density. If we want to study the system over 
medium time scales, it is obviously important to use a time t in the construction 
of the moment map that is short compared to the escape time between wells, but 
long enough for the noise (dynamics) to allow the sampling of the features of the 
well bottom. On a longer time-scale it is necessary to incorporate the transition time 
between wells as is done, for example, in the method of conditional averaging 1 29 1. 
• Computational Savings. The moment map can lead to computational savings in two 
primary ways: 

(i) the map $ can be used in finite dimensional bifurcation and continuation stud- 
ies; 

(ii) the estimated vector field F can be used to advance the moments over several 
multiples of the time-step r. 

In case (i) savings can arise from using accelerated methods, such as Newton itera- 
tion in a continuation environment, to find fixed points. In case (ii) savings arise by 
considering maps of the type 

to advance the moments through It time units, using solution of the full problem 
\2>.l\ or ( 13. 6> only over r time units. (If ^ = 1 this simply reduces to the moment 
map). The above formula constitutes a projective forward Euler explicit coarse inte- 
grator Much more sophisticated integrators, including multistep and implicit ones 
can also be used; a rigorous analysis of savings in case (ii) has only recently been ini- 
tiated (30||2]|32|. These ideas have been applied to a wide range of problems, both 
deterministic and stochastic, see e.g. l^,TlT,TT,T^,TTWWW'4r,'34','35ll36l 
and other references in [3,j4J. An approach related to case (ii), which can be fully 
optimized for variance reduction and so forth when explicit time-scale separation 
occurs between the x and y dynamics in ( 13. 8> . is outlined in 1371 : for a rigorous 
analysis see 1 8 1 . 

4. Examples. Here we explore a series of examples of moment maps. We start with 
examples based on the OU process for which explicit representation is possible. In these 
cases the moment maps are linear. We then proceed to the more interesting nonlinear maps 
arising from systems with double-well potentials. 

4.1. The OU Process. Consider the OU process 

rrdW 

-77 = -ax + VA— . (4.1) 

at at 

This is essentially the simplest example of ( 13. U and corresponds to \2.5l in the case of a 
quadratic potential. 

The exact solution of this process is 

x{t)=e-°''x{0) + y/X f e'^^'-'^Wis). (4.2) 
Jo 



For first-order moment map on x, we take initial data with Dirac measure with density 
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Fig. 4.1. Phase portraits for first-order (left) and second-order (right) moment maps for the OU process. 
Trajectories for these linear maps are shown starting from several different initial conditions. Parameters are a = 1, 
A = 2, and t = 0.5. 



p{x; x) — S{x — x). The map on the first moment x is expHcitly 

*,., = E.M=/.(e-'.,.-S,M.. 

From (14. 2> we have 

= e-"^x. (4.3) 

The map $ is linear and has a unique, globally attracting fixed point at x = 0. Figure 14.11 
shows a phase portrait for this simple map. 

Before discussing this we consider the second-order moment map with mean x and stan- 
dard deviation a as co-ordinates. In this case the initial data has density 

_ . 1 -(£^ 

p(x;x,a) 



V27rcr 

From (14. 2> we then have that the moment map on {x, a) is given by 



$i(x,cr) =e-"^x (4.4) 

$2(x,a) ={e-2"V2 + - e-2"-]}i (4.5) 
la 



While not a linear map on (x, cr), this is linear on {x, cr^). Fi sure W/\\ shows a phase portrait 
for map (14. 4> . The map has the unique fixed point (x, a) — (0, VT^D which is globally 
attracting. 

The solution to (|^} is Gaussian if xq is Gaussian. Hence the second-order moment 
map ( I4.4t gives exact time r samples of the distribution of the SDE. This unique fixed point 
of the map characterizes the unique invariant (Gaussian) measure of ( 14. 1> . In contrast, the 
first-order moment map, with ji a Dirac, can only approximate the solution. Although this 
map does not quantitatively represent the solution, since it contains no information about the 
width of the measure, it captures the correct dynamics of the first-order moment and shows 
that probability mass initially far from the origin will be transported inward. 

4.2. ID SDE: The Double Well Potential. We now present a detailed study of moment 
maps for the one-dimensional SDE \2.5\ with double-well potential. In this section we focus 
on the dynamics of these maps using numerical simulations. In the next section we analyze 
the maps, in particular the nonlinearity of the maps, in more detail. 
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After suitable scaling SDE ( 12. 5> can be rewritten in the notation of ( 13. Il l as 



X — 



V'{x) + W. 



(4.6) 



We consider the double-well potential 



V'{x) 



x{x'^ — jl) + v. 



(4.7) 



For V ^ Q the potential is symmetric about zero and for v small this symmetry is weakly 
broken. The potential has two local minima for|i/| < 2(^/3)3/2 and one minimum otherwise. 

The first-order (Dirac -based measure) and second-order (Gaussian-based measure) mo- 
ment maps for this equation are nonlinear. In particular these maps have multiple stable fixed 
points which undergo bifurcations as the potential (/i or v) is varied. We are interested in 
these fixed points and their stable and unstable manifolds as a function of /i for v fixed. We 
shall consider two cases, the slightly asymmetric case v — Q.'i and the symmetric case v = 0. 
We resort solely to numerical studies of the moment maps throughout this section. In brief, 
we use Monte Carlo simulations to evolve densities forward over time interval r, as in the 
evolution from pio pin figure l3Jl This numerically determines the moment maps. By em- 
ploying additional techniques we can compute steady states and bifurcations. The effective 
fixed point, bifurcation and continuation calculations require estimates of the Jacobian of the 
moment map (or its action). This is achieved by using nearby initializations of the moment 
map (see 1141 1151 as well as Q E] 1221 and the monograph 1 23 1 for matrix-free implementa- 
tions of Newton-GMRES). 

We first consider the moment maps for the slightly asymmetric potential with represen- 
tative values of p and map time t. Figure ^21 shows phase portraits for both first-order and 
second-order moment maps. Each map has three fixed points. These are shown together with 
unstable, and for the second-order map also stable, manifolds of the unstable fixed point. 

Figure |431 shows one iteration of both the first- and second-order maps. Consider the 
first-order map. The initial density p(0) = p{x] x) is a Dirac delta at x, here a point slightly 
to the right of the unstable fixed point near zero. After time t = 0.1 the mean of the density 
has moved to the right and hence the map takes x to the right in this case. The density spreads 
considerably but over r — 0.1 it remains nearly symmetric (the mean is indistinguishable 
from the maximum). The initial density for the next iteration is a Dirac delta displaced to the 
right. 

For the second-order map the initial density p(0) = p{x; x) is a Gaussian centered at x 
with width a. Here (a, x) — (0.418, 0.409) corresponds to a point on the lower branch of the 
stable manifold of the saddle fixed point. After t = 0.1 time units the density has spread and 
the mean has moved slightly to the right. The map thus corresponds to substantial increase 
in a and small increase in x. The density p(r) is slightly non-Gaussian as can be seen in 
comparison with the initial (Gaussian) density for the next iteration. 

Figure l4~4l shows all fixed points in Figure l4r2l In each case we plot the density X) 
corresponding to each fixed point in moment space as well as the density p(t). The sta- 
ble fixed points of the second-order map are the metastable measures centered in each well. 
Specifically, the Gaussian measures p{x;x,a) corresponding to the stable fixed points are 
indistinguishable from the evolved densities p(r). As we shall show this is independent of r 
over a very large range of t. Intuitively this is because on any time scale, up to the very long 
time scale needed to reach the equilibrium distribution, these Gaussian measures are approx- 
imately invariant. The stable fixed points of the first-order map are not invariant measures. 
However, starting from initial condition p{x; x) = S{x) where x is indistinguishable from the 
potential minimum, the density simply fills out (symmetrically), the (locally quadratic) well 
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Fig. 4.2. Phase portraits for first-order (left) and second-order (right) moment maps for the one-variable SDE 
in the case of a slightly asymmetric potential. Fixed points are indicated by crosses. The stable (for second-order 
map) and unstable manifolds of the middle fixed point are shown. Note, the stable manifold of the saddle in the 
second-order map does not pass through the middle fixed point of the first-order map. Parameters are fi = 6, 
V = 0.3, r = 0.1. 




Fig. 4.3. One iteration of the first and second order maps whose phase portraits are shown in iieure \4.2\ 
The bold red curve shows p(0) = p(x; X"), the thin green curve shows pir), and the dash bold red curve shows 
/3(a;;X"+i). (See fisure\Tl\) 



bottom. Note that r = 0. 1 is close to, but not quite, the time necessary to reach the metastable 
density starting from the Dirac measure. 

The unstable fixed points for the maps are understood as follows. For the first-order map, 
the unstable fixed point is at the local maximum of the potential. Starting from a Dirac delta 
p{x;x) = S{x), the density spreads symmetrically, since the maximum is locally quadratic 
and hence symmetric. Hence after time t — 0.1 the mean is stiU at local maximum of the 
potential. Only for times t long enough for the density to fill the two wells, and hence have 
a mean different from the local maximum, would the fixed point be different from the local 
maximum. For such times the fixed point would approximately be the mean of the equiUb- 
rium density. For the second-order map, the saddle fixed point corresponds to a Gaussian 
p{x; X, a) which is quite broad. The evolved density p(t) is far from Gaussian; it simply has 
the property that its first two moment agree with those of the initial Gaussian. The saddle 
fixed point is quantitatively sensitive to the map time r (see below). Qualitatively, however, 
for any value of r the saddle fixed points are broad Gaussians. 

The stable fixed points of both maps correspond to metastable states (measures) of the 
underlying process. The metastable states are very nearly Gaussian measures, because the 
wells are locally quadratic, and they are thus well captured by the low dimensional moment 
maps: the densities corresponding to the stable fixed points of the second-order map are 
virtually indistinguishable from the metastable states. The fixed points of the first-order map 
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Fig. 4.4. Densities p{-\ X), shown with bold blue curves, corresponding to fixed points for first-order (left) 
and second-order ( right) moment maps shown in Fisur ^!2\ Thin green curve show the evolved density p(T)for each 
case. (For the two stable fixed point of the second-order moment map the evolved density p{t) is indistinguishable 
from p{-\ X).) The potential V(x) is shown as a dashed curve. 



capture the means of the metastable distributions. The stable fixed points are insensitive to 
the value of r over a large range of r. (See Figure ITTI below). This lack of sensitivity to r 
suggests that these fixed points are meaningful characteristics of the observed dynamics over a 
range of observation time scales. The unstable (saddle) fixed point for the first-order moment 
map is also insensitive to the value of r but the unstable fixed point for the second-order map 
is sensitive to r. This suggests that the fixed points of the first-order moment map provides 
a useful description of the dynamics (for relatively short times) close to both the saddle and 
the well bottoms; the second-order map fixed points provide a meaningful description of the 
effective dynamics close to the bottoms of the two wells, but not in the neighborhood of the 
saddle; this is essentially because a reduced equation in terms of the second-order moments 
does not appear to successfully close in the neighborhood of the saddle. 

We now turn to the behavior of the fixed points as a function of well-depth. Figure 1431 
shows bifurcation diagrams for each moment map as a function of /i, including ji for which 
the potential has a single well (basically /j, < 0). Local extrema of the potential are shown 
for comparison. The right-most end of each bifurcation diagram (/i — 6) corresponds to the 
phase portraits just considered. The fixed points for the first-order map follow the extrema of 
the potential closely for all /i, including near the saddle node bifurcation. The second-order 
fixed points do not. In Figure 14.61 we show fixed points in cases where the potential is far 
from locally quadratic. One case is /i = and the other is /i = 2.4, very near the value 
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Fig. 4.5. Bifurcation diagram for first-order (left) and second-order (right) moment maps for the one-variable 
SDE in the case of a slightly asymmetric potential. Lines show local minima of the potential. 
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Fig. 4.6. Densities, shown with bold blue curves, corresponding to fixed points for first-order (left) and 
second-order ( right) moment maps at two values of fi where the non-quadratic aspect of the potential is apparent. 
Thin green cur\'e show the evolved density p(t) for each case. The top case is fi = 0. The bottom is fi = 2.4, very 
near the saddle-node bifurcation for the second-order map in Fisure W^ The potential V{x) is shown as a dashed 
curve. 



corresponding to the saddle-node bifurcation of the second-order map. In both cases the first- 
order fixed point is at the potential minimum while the mean of the second-order fixed point 
is noticeably different from the minimum as can also be seen in Figure l431 

We show in figure lTTl how steady states for the second-order moment map are affected 
by the choice of the map time t. To understand what the figure shows, it is helpful to first 
consider the fixed points for /i < 0. Neither x nor a vary significantly with r and cr is not 
large. While not as easy to see, the stable fixed points for /i > 2, behave similarly. The 
stable fixed points correspond to the uppermost and lowermost branches in the x-plot and the 
bottom branch in the cr-plot. Both stable fixed points have approximately the same, relatively 
small, value of cr. The intermediate, generally unstable, fixed points have larger values of cr; 
these vary quantitatively and qualitatively with r. The number of unstable fixed points can 
change with r, e.g. at = 6, r = 0.1 there is one saddle fixed point between the two stable 
fixed points (figure whereas at /x = 6, r = 1.0 there are three fixed points between the 
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two Stable points (similar to figure l4~8l . The conclusion is that the stable fixed points of the 
second-order moment map which correspond to stable or metastable measures of the SDE 
are largely insensitive to the time t used to define the map. The other fixed points typically 
correspond to broad distributions and depend quantitatively on t. This dependence of the 
fixed points of the moment map on r suggests that they are not useful features of the effective 
dynamics - which in turn suggests that the effective behavior does not usefully close at the 
second moment level in the neighborhood of these fixed points. 

Finally we consider the moment maps for the symmetric double-well potential. Figure 
l4.8l shows phase portraits, similar to Figure l4r2l for the asymmetric case, while Figure l4~9l fixed 
points, similar to Figure l4~4l for the asymmetric case. Figure lTTOl shows a bifurcation diagram 
as a function of ji. An important observation from the data presented in the symmetric case 
is that the moment map produces stable equilibria which are far from metastable states. The 
Gaussian measures corresponding to these fixed points are very broad. 

4.3. Metastability and the Double Well Potential. We now present some analysis of 
the nonlinear map. Consider the SDE (14. 6> . The adjoint of the generator for this process is 



The equation has a unique invariant density poo, in the nuU-space of £*, and given explicitly 
by 



= Z-icxp{-2T/(a;)}, 2 = / exp{-2\/(a;)}dx. 



(4.8) 
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Fig. 4.8. Phase portrait for first-order (left) and second-order (right) moment maps for the one-variable SDE 
in the case of a symmetric potential. Fixed points are indicated by crosses. The stable (for second-order map) and 
unstable manifolds of the saddle fixed point are shown. 




Fig. 4.9. Fixed points for first-order (left) and second-order (right) moment maps shown in lisure [4.8l Same 
conventions as in fieure \4.4\ Top plots show the right stable fixed point. The middle plot shows the right saddle for 
the second-order map. The bottom plot shows the middle fixed point (saddle for the first-order map and stable fixed 
point for the second-order map). The other points Fisure W^^ are obtained by symmetry. 



The operator poo^ C* is self-adjoint in the space i^(R) (see Proposition 2.2, II 11 ). We let 
(•, •) denote the weighted L^(R) inner product 



Poo \X ) 
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Fig. 4.10. Bifurcation diagram for first-order (left) and second-order (right) moment maps for the case of the 
symmetric potential. Lines show local minima of the potential. 



and we write the eigenvalue problem 

L*4>j{x) = Xj(f)j{x) 

with eigenvalues ordered so that 

= Ao > Ai > A2 > . . . . 
We may choose the normalization 

Since 4)o{x) = Poo{x), we have 

/ (f>o{x)dx — 1, / (f>j{x)dx = 0, j > 1. 
Jr Jr 

Now, the solution p{x, t) of the Fokker-Planck equation can be expanded in the eigen- 
functions as 

00 

p{x,t) = ^aj(t)0j(a;), 
j=o 

where 

Notice that ao(0) = in all cases, because p{x, 0) is a probability density function. 

Assume V{x) in (14. 6> is a double well potential with deep wells relative to the noise. 
Then the analysis and numerical evidence in ||5] II II suggests that it is reasonable to assume 
that 

e A1/A2 < 1. 

Thus there exists a spectral gap and, noting that Aq = 0, this suggests that after times r of 
order —1/Ai the density p{x, t) can be well-approximated by only the first two eigenfunctions 
(f>Q and (/>! . 

Assuming that V" 7^ at the two well bottoms, then Poo{x) is well-approximated as 
the weighted sum of two Gaussians g±{x); this may be verified from ( 14. 8> . We may assume 



THE MOMENT MAP 



19 



that the Gaussians are normalized to be probability densities, and then define their means and 
standard deviations by 

/ g±{x)dx = l, / xg±{x)dx=g±, / [x - g±fg±{x)dx = a'^. 

JM JR JR 

We then write 

(t)o{x) = Poo{x) « ag+{x) + (1 - a)g-{x), (4.9) 

where a determines the relative weight of the two Gaussian contributions. Furthermore, by 
orthonormality, it may be shown that 

01 (x) « - a)}[g+{x) - (4.10) 

We can now use the approximations ( 14. 9> , ( I4.10> to understand the nonlinearity in the 
moment map for the case of the double well potential. We focus on the second-order map. In 
this case p{x, 0) = p{x; x, a) will be Gaussian. We choose r = — T/Ai, for some T of order 
1 and set 

Then, due to the spectral gap in the eigenvalues, we have for e <C 1, 

pix,T) « 0o(a;) + ai(O)e"'^0i(a;) 

= ia + P)g+{x) + {l-a-f3)g^ix) (4.11) 
73+(a:) + (1 - 7)g_(x) 

for 7 = a + /?. 

The key to the dynamics of the moment map is manifest in the formula ( 14. IH . Given 
any Gaussian with mean and standard deviation {xq, o-q) we project the density p{x, 0) = 
p{x-xo,(To) onto the basis {4'jix)}j^i. Then the evolution shows that p{x,t) is given by 
drm iand 

Si =7.9+ + (1 - 7)5- (4.12) 
af ^Pal + (1 - + (1 - f3)(i[g+ - g_ f. (4.13) 

Since 7 depends nonlinearly on (xq, cto), through ai(0), we have a nonlinear map [xq, cto) ^ 
(a;i, CTi). In principle this map can be computed explicitly, though this requires knowing the 
eigenfunctions 01 and 0o accurately. 

This analysis can be applied to our computational studies of the double well potential 
to gain further insight into the moment map. We employ the symmetric double well poten- 
tial considered at the end of i|4.2l In this case the eigenfunctions 0i and 00 are accurately 
approximated by ( 14. 9> and ( I4.10t with a — 1/2. We use r = 1 in the computations which 
follow. (We shall see that A2 ~ —5 so that t\2 — —5.) 

Figure imi shows the moment map in the coordinates suggested by the preceding analy- 
sis. The corresponding evolution of the density is shown for one iterate of the map. We wish 
to view the evolution of the density p{x,t) in terms of the amplitudes aj{t) of projections 
onto the eigenfunctions (pj. We know that ao(t) = 1 so there is no need to show this ampli- 
tude. The essential amplitude is ai. The effect of all the higher amplitudes aj, j > I can be 
summarized by a single scalar x defined as 

00 

X = II = IIP- ao0o - ai0i||2, 

J=2 
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with p — p{-;t). 

Consider point 1 in figure 14.111 To the right is shown the Gaussian density p(0) = 
p{x\ ctq) determined by a point (a;o, ctq) in moment space. This density has a significant 
projection onto the higher modes , j > 1 and x is significantly greater than zero. From the 
analysis we expect the density to evolve such that x decays to zero on a time scale faster than 
the dynamics of ai. The thick black curves in l4.1 ll show this evolution. There is little change 
in ai as the system evolves toward x = 0. The decay to x = is ultimately exponential as is 
shown in figure l4TT2l From this we estimate that A2 — —5. 

After time r = 1 the system is at point 2 with corresponding density shown at the 
right. The resulting density is no longer Gaussian as expected from ( 14. lU . The second-order 
moment map is obtained by determining {xi ,(Ji), the mean and standard deviation of density 
2. For the next iteration of the map one constructs a Gaussian density with this mean and 
standard deviation, point 3 in Figure ITTTl and repeats. The dashed line connecting points 
2 and 3 illustrates this. Thus the moment map takes Gaussian p{x] xq, ctq) determined by 
{x[),<j[)) (point 1) to xi, (7i) determined by {xi.ai) (point 3) where the map can be 
again be iterated. Note that the evolution from point 1 to point 2 is due to linear flow of the 
Fokker-Planck equation. Nonlinearity results from the projection of density at point 2 back to 
{xi , (Ti ), i.e. going from point 2 to point 3 introduces nonlinearity into the map. Further note 
that the mean has moved slightly to the right after one iteration of the map. Hence, on the 
next iteration less of the mass will move into the left well, (as in point 2). In this way the map 
stabilizes the meta-stable states corresponding to localization of density into a single well. 

Now consider exactly the same evolution seen in the moment-map coordinates (x, a) in 
Figure I4TT3I The green curve is that generated by oq = 1, —1 < ai < 1, aj = 0, j > 1. 
This curve is also shown as green in Figure ITTTI This is the slow manifold for the system. 
Starting from point (xo, ctq), point 1, the evolution of (x, a) as p{x, t) evolves is shown in 
bold. This is the decay of the modes 0j, j > 1. After time r the system reaches (ii, cti), 
point 2. Even though the transient dynamics is such as to move initially away from the slow 
manifold, the evolution brings the system back, as it must. The projection back to Gaussian 
density does not change x and a so points 2 and 3 appear the same in Figure lTljl 

We know that as the system evolves from point 1 to point 2 the density became non- 
Gaussian. We show this in Figure l4T4l bv showing the dynamics out of the (i, cr) plane. 
Here C, is given by 

C = /5(-,S,cr)||2, 

with p = p{-,t) and is similar in spirit to x- C is ^ measure of how far the density is from 
Gaussian whereas x measure how far the density is from the slow manifold. However, these 
have opposite roles and behavior Gaussian densities correspond to C = 0, but since such 
densities are not in general on the slow manifold they correspond to x ^ 0. 

Starting from point 1 in Figure l4TT4l C, is necessarily zero since the density (Figure B. Ill 
point 1) is Gaussian. As the system evolves toward the slow manifold and becomes non- 
Gaussian, C increases (point 2). Projection back to Gaussian moves the system vertically 
downward to ^ = (point 3). 

Now consider the case ai ~ 1, near the local minima of the potential wells (we consider 
only the right well, the left is the same). One sees in Figures B. 1 ll and l4. 14l that points on the 
slow manifold correspond to nearly Gaussian densities. This can be most clearly seen in l4.14l 
where the slow manifold falls to near C — 0- The end point of the green curve is ai = 1. In 
Figure imi we seen that the red points (the Gaussian densities in a coordinates) fall to very 
nearly x = meaning that these densities are almost exactly represented by a sum of (pQ and 
01 . The small gap between the slow manifold and the Gaussian density (seen in both Figures 
I4.11l and l4.14> reflects that fact that the metastable density is not exactly Gaussian. 
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Fig. 4. 1 1. Iterates of the moment map as seen in ai, x coordinates. Red dots show points with Gaussian 
densities p(x\ x, rj). The Gaussian densities corresponding to points labeled 1 and 3 are show to the right. The 
evolution of the density over time r is shown by bold curves (actually fine series of bold points) with green crosses 
indicating the the final time. The density corresponding to point 2 is shown to the right. Dashed lines indicate the 
projections back to Gaussian density which preserve the mean and standard deviation of the distribution. 








time 



Fig. 4. 12. Exponential decay of higher modes. Dashed cur\'e has slope —4.8. 



In Figure I4T5I we show the dynamics in (i, a) coordinates showing all the fixed point 
of the moment map. This is similar to Figure l4~8l right) except that here t — \. The figure 
shows trajectories starting from four initial conditions. Note that the slow manifold accurately 
captures the unstable manifold of the saddle fixed points. 

4.4. 2D SDE. In this section we consider moment maps for the 2D SDE ( I2.4> presented 
in ^12. 21 The dynamics are potentially richer than for the ID SDE considered up to now. 
Nevertheless, the stabilization of metastable states is the same as for the ID SDE. 

As before we examine maps for both first-order and second-order moments. The first- 
order map can be written as "I>(a;i, a;2) where xi and X2 are means of Q and P respectively. 
The second-order map can be written as ^'(xi, 2^2, fi, (T2, c) where cti and (T2 are the standard 
deviations of Q and P respectively and c is the cross correlation. Other coordinates could be 
used for the five-dimensional phase space. We again consider the slightly asymmetric double- 
well potential (12. 3> for parameters similar to those use for the ID SDE. All results have been 
obtained numerically from simulations of equations (12. 4> for the case Af = 1, 7 = 1, /3 = 2. 

Figure 14.161 shows typical phase portraits for the first-order and second-order moment 
maps. The first-order map exhibits the dynamics typical of bistable damped oscillators. Sim- 
ilar to the ID case, the fixed points are located at, or very close to, (xc, 0) where Xc is a local 
extremum of the potential. The second-order map has five fixed points, similar to those seen 
in figure l4~8l including a stable fixed point with a very broad Gaussian measure. Typically 
trajectories of interest approach either one or the other of the stable fixed points correspond- 
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Fig. 4. 13. Iterates of the moment map seen in {x, cr) coordinates. The points correspond to exactly the same 
points as in Figure WTT] The bold curves (actually fine series of bold points) show the evolution of (S, cr) as the 
density evolves between iterates of the map. The green cun'e is the slow manifold (x = 0) ^^^o shown in \4.11\ 




Fig. 4.14. Iterates of the moment map seen in {x, C,) coordinates. The points correspond to exactly the same 
points as in Fisures ^t. I I\ and \4. 1 3\ The bold curves (actually fine series of bold points) show the evolution of(x, () 
as the density evolves between iterates of the map. The green curve is the slow manifold. 



ing to the potential minima. The moment maps for the 2D SDE stabilize metastable states in 
a very similar way to that found for the ID SDE. 

Figure lTTTl provides a better view of the dynamics of the second-order moment map and 
shows how trajectories approach the stable fixed points. A Gaussian measure in two variables 
can be visualized as an ellipse in the plane specified by five numbers: the center, the semi- 
major and semi-minor axes, and the orientation. So for each point in the five-dimensional 
phase space of the moment map we plot an ellipse in the plane. One can think of each ellipse 
as corresponding to the level set of a Gaussian density. 

Two trajectories are shown, one with the ellipse at every iteration of the map plotted, 
and the other with only a few representative ellipses plotted. One can see how densities 
evolve under the map toward stable equilibria. Trajectories from almost all initial condition 
distributions that are not too broad, (i.e., initialized within one of the two metastable wells, as 
discussed above) evolve to one or the other of the two fixed points similarly to what is shown 
in figure ITTtI 

For completeness we show in fi sure ITTsl bifurcation diagrams for the moment maps for 
the 2D SDE. These bifurcation diagrams reveal much the same features as for the ID SDE. 
Fixed points of the first-order moment map track the potential minima. For the second-order 
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Fig. 4. 15. Iterates of the moment map seen in (x, a) coordinates. Same as Fisure W73\ exceDt over a larger 
range of coordinates and same as l4.8l except here t = 1. 
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Fig. 4.16. Phase portrait for first-order (left) and second-order (right) moment maps for the two-variable 
SDK with a slightly asymmetric double-well potential. Fixed points are indicated by crosses. For the first-order map, 
stable and unstable manifolds of the saddle fixed point are shown. For the second-order map, unstable manifolds 
of the saddle fixed point are shown. The stable manifolds are four dimensional. Points show some representative 
trajectories. Parameters are p, = 6, u = 0.3, r = 0.1. 

map, stable fixed points corresponding to metastable states exist except in regions near where 
the potential bifurcates from single- to double-well. Clearly, close to such parameter values, 
the separation of time scales between equilibration in one well and transition to the other is 
no longer present, and the fixed points we find depend on the map reporting horizon t. Fixed 
points, both stable and unstable, corresponding to broad distributions, separate the stable 
fixed points. While not shown, we find that the fixed points corresponding to the stabilized 
metastable states are essentially independent of the time t over which the map is defined; 
this suggests that the map is a good effective description in thek neighborhood, but not a 
useful one close to the r-dependent fixed points. The ability to test the sensitivity of the map 
dynamics and fixed points to the parameter r, as well as the ability to use maps of different 
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Fig. 4.17. Dynamics of the second-order moment map for the two-variable SDE. Two trajectories are vi- 
sualized by plotting ellipses corresponding to points in the five-dimensional phase space. One trajectory starts at 
{xi, X2, eri, (72, c) = (0,3,0.01,0.01,0). Only a few representative ellipses are shown. The curx'e shows the 
path of the center of the ellipses. The other trajectory starts at (xi,X2,cri,cr2,c) = (0,-1,0.1,0.5,0). In this 
case every points on the trajectory is shown. Two stable fixed points of the map are .shown as bold blue ellipses. 
Parameters are p, = &, v = 0.3, r = 0.1. 




Fig . 4.18. Bifurcation diagrams for the first-order ( left) and second-order ( right) moment maps for the two- 
variable SDE. Parameters are v = 0.3, r = 0.1. 

orders, allow potential tools with which to "test online" the validity of a given map as an 
effective model of the detailed dynamics. 

4.5. Heat Bath. Finally we consider the dynamics of a particle in a heat bath as de- 
scribed in il2.1l Moment maps for this example are of the type defined for ODE systems in 
j|3.2l Nevertheless we expect the moment map for the ODE system to behave very much like 
that of the 2D SDE since the SDE is known to capture the dynamics of the heat bath model in 
the limit of a large bath. From a computational viewpoint in fact there is not much distinction 
between the stochastic (SDE) and the deterministic (ODE) cases since in both case we nu- 
merically compute the moment maps using Monte Carlo simulations to evolve densities over 
time interval r. 

There are two related new issues, however. The first is that N, the number of particles in 
the heat bath, is now a parameter which could potentially affect the dynamics of the system. 
The other related issue is that there is a minimum time interval over which we should define 
the moment map. For any given bath size N there is a maximum frequency ojm of the oscil- 
lators in the bath, where ojm — N^^^. We therefore should take the map time r to be at least 
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of the same order as the 1/LOm- We always use r > 27r/aj,„. 

Other than the preceding two points the only significant difference between the heat 
bath and the 2D SDE is that the heat bath requires significantly more computation to evolve 
densities forward in time. Hence the moment map is much more expensive to compute for the 
heat bath than for the SDE. For this reason, we have limited our studies to a fixed potential: 
equation \2.2>\ with — 4:, v ^ 0.3. This is the potential used for the simulations shown in 
the introduction. 

Figure 14.191 shows phase portraits of the moment map for the heat bath model. The 
first-order map shows the expected three fixed points at the local extrema of the potential 
and exhibits the dynamics of bistable damped oscillators. The map has indeed stabilized the 
metastable states with a well defined boundary (the stable manifold of the saddle) separating 
the basins of attraction. The location of the fixed points does not depend in any significant 
way on the number of particles in the bath or on the map time r. The stable and unstable 
manifolds do vary somewhat, primarily with the map time r, but are always qualitatively as 
seen in figure ITTqI 

For the second-order map we show phase portraits in the style of figure 14.171 for the 
2D SDE system. We show two trajectories for each of three cases. The middle case is for 
N — 8000, the value used for simulations shown in the introduction. The maximum oscillator 
frequency in the bath is LOm — 20 and so we use a map time of r = 0.4 > tt/IO. 

We show a map starting at {xi,X2, cri, <J2, c) = (0, 3, 0.01, 0.01, 0). This initial condi- 
tion corresponds exactly to the initial density used figure [131 One sees the similarity between 
the trajectory for the moment map and the evolution of the density in figure [131 However, 
the "leaking" of mass into the left potential well observed in figure ^3] is prevented by the 
moment map via the mechanism illustrated in figure ITTTl The moment map is nonlinear and 
has the two stable fixed points where the density is only metastable. Most trajectories evolve 
to one or the other of these fixed points. 

For the same potential we have investigated the effect of N, the number of particles in 
the heat bath, on the moment map. We find that the map is very insensitive to N at least 
for N > 1000. For large N one can use a smaller map time r and the dynamics do depend 
weakly on r. Specifically, the fixed points for the three cases in figure l4T9l are very slightly 
different, though this cannot be seen on the scale of the figure. This difference is not due 
directly to N, but to the value of r. 

5. Conclusions. In this paper we have introduced a mathematical framework intended 
to outline and clarify some aspects of the coarse-grained approach to analyzing stochastic 
and deterministic systems. In particular we have given a precise definition of the moment 
map. These are maps on the (low-dimensional) space of low-order moments of probability 
measures. We have considered these maps both for stochastic systems and for deterministic 
systems with random initial data. While the underlying evolution of densities in both systems 
is linear, the moment maps are typically nonlinear Our main focus has been understanding 
the origins of this nonlinearity. 

In this paper we sought to establish a connection between the dynamics of coarse-grained 
observables (such as moments of evolving reaUzation ensembles) and the nonlinear dynamics 
one expects at the deterministic limit. Contemporary estimation techniques would allow us to 
recover both the deterministic and the stochastic component of an effective stochastic model 
(e.g. 1391 ). Then, instead of using integral changes of coarse-grained observables, we could 
directly seek the extrema of an underlying effective potential, or even the extrema of the 
corresponding equilibrium density (see, e.g. 140 41 42 ). 

We have presented results for a number of model systems. We have first considered the 
simple OU process for which a full analysis is possible. Then using a combination of nu- 
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Fig. 4.19. Phase portraits showing the dynamics of moment maps for the heat bath model. First-order (left) 
and second-order ( right) maps are shown. For the first-order map N = 8000 particles is used. For the second-order 
map the following are used: (top) N = 256000, t = 0.1; (middle) N = 8000, r = 0.4; (bottom) N = 1000, 
r = 0.8. 



merical studies and analysis, we have considered in most detail a one-dimensional SDE with 
a double-well potential. This system provides the simplest example of a nonlinear moment 
map. In particular this example shows how the moment map can stabilize metastable densities 
of the underlying linear flow. We have additionally presented numerical results for moment 
maps computed for two other systems with double-well potentials - a two-dimensional SDE 
and a deterministic ODE system with many degrees of freedom. Maps for both of these sys- 
tems show the basic features found for the one-dimensional SDE, namely nonlinearity and 
the stabilization of metastable densities. 

One of the important issue that arises naturally in this computational framework is the 
importance of the observer. How long does a physical observer have to wait before declaring 
that an observed quantity is at steady state ? This is clearly related to our testing the depen- 
dence of the map fixed points to the map reporting horizon. We also saw that the initialization 
of computational experiments (whether within or not within a well) can be vital in the exis- 
tence of an effective reduced model (this is related, as we mentioned, to conditional averaging 
techniques). 
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